Visual telephone unit and visual telephone system therewith

专利摘要:
A visual telephone unit is disclosed, that comprises a first inputting portion for inputting a picture frame, a second inputting portion for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame, and a rotating portion for rotating the picture frame by the compensation amount.
公开号:US20010008412A1
申请号:US09/757,568
申请日:2001-01-11
公开日:2001-07-19
发明作者:Takeshi Ando；Masakatsu Takizawa
申请人:NEC Corp；
IPC主号:H04N7-142

专利说明:
[0001] 1. Field of the Invention [0001]
[0002] The present invention relates to a visual telephone unit for transmitting a digital picture signal of an input picture or receiving a digital picture signal from another visual telephone unit. The present invention also relates to a visual telephone system having such a visual telephone unit. [0002]
[0003] 2. Description of the Prior Art [0003]
[0004] A visual telephone conference system that allows the users at remote locations to have a conference is known. The visual telephone conference system has visual telephone conference units that are disposed at designated conference points. The designated conference points are connected using for example an ISDN telephone line network or the like so that a digital picture signal and an audio signal are transmitted and received therebetween. [0004]
[0005] In recent years, as mobile communication units such as cellular phone units are becoming common and technological innovations allow the transmission band to widen, a visual telephone conference may be held using a mobile visual conference unit that is a cellular phone unit having a small photographing unit such as a CCD (Charge Coupled Device). [0005]
[0006] A visual telephone conference is performed using cellular phone units that are connected through an exchange and base stations so that a digital picture signal and an audio signal are transmitted and received therebetween. [0006]
[0007] FIG. 1 is a schematic diagram showing the structure of a visual telephone conference unit that is structured as a cellular phone unit. Referring to FIG. 1, a visual telephone conference unit [0007] 901 comprises a picture input unit 902, a microphone 903, a liquid crystal display 904, and a speaker 905. The picture input unit 902 inputs a picture. The microphone 903 collects a voice. The liquid crystal display 904 displays a picture of a digital picture signal received from another visual telephone unit. The speaker 905 outputs a voice.
[0008] When the user uses the visual telephone conference unit [0008] 901, he or she often holds it with his or her hand or places it on a desk. The visual telephone conference unit 901 is placed in such a manner that the frame of the picture input unit 902 is placed sideways or lengthways corresponding to the shape of a photographing object.
[0009] However, in the conventional visual telephone conference system, a picture frame that is input from the picture input unit [0009] 902 of the transmission side visual telephone conference unit is directly transmitted to the reception side visual telephone visual telephone conference unit, the orientation of the reception side visual telephone conference unit should be matched with the orientation of the transmission side visual telephone conference unit.
[0010] Thus, when the user has to place the visual telephone conference unit on a disk that is inclined, the visual telephone conference unit is inclined against a photographing object. As a result, the reception side visual telephone conference unit displays an inclined picture. In such a case, it is necessary to hold the reception side visual telephone conference unit in the inclined state. Thus, the operation of the reception side visual telephone conference unit is inconvenient. [0010] SUMMARY OF THE INVENTION
[0011] The present invention is made from the above-described point of view. An object of the present invention is to provide a visual telephone conference system that does not need to adjust the orientation of a reception side visual telephone conference unit corresponding to the orientation of a transmission side visual telephone conference unit. [0011]
[0012] According to a first aspect of the present invention, there is provided a visual telephone unit, comprising: first inputting means for inputting a picture frame; second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and rotating means for rotating the picture frame by the compensation amount. [0012]
[0013] According to a second aspect of the present invention, there is provided a visual telephone unit, comprising: first inputting means for inputting a picture frame; second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and rotating means for rotating said first inputting means by the compensation amount. [0013]
[0014] According to a third aspect of the present invention, there is provided a visual telephone unit, comprising: first inputting means for inputting a picture frame; detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and rotating means for rotating the picture frame so that the rotation angle becomes zero. [0014]
[0015] In visual telephone unit according to the third aspect, said detecting means may designate the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle. [0015]
[0016] The visual telephone unit according to the third aspect may further comprise: a head set having two speaker portions and a microphone portion each having a light source, wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle. [0016]
[0017] According to a fourth aspect of the present invention, there is provided a visual telephone unit, comprising: receiving means for receiving a picture frame; inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and rotating means for rotating the picture frame by the compensation amount. [0017]
[0018] According to a fifth aspect of the present invention, there is provided a visual telephone unit, comprising: receiving means for receiving a picture frame; detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and rotating means for rotating the picture frame so that the rotation angle becomes zero. [0018]
[0019] In the visual telephone unit according to the fifth aspect, said detecting means may designate the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle. [0019]
[0020] The visual telephone unit according to the fifth aspect may further comprise: a head set having two speaker portions and a microphone portion each having a light source, wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle. [0020]
[0021] According to a sixth aspect of the present invention, there is provided a visual telephone system having a first visual telephone unit and a second visual telephone unit; wherein the first visual telephone unit comprises: inputting means for inputting a picture frame; receiving means for receiving a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame from the second visual telephone unit; and rotating means for rotating the picture frame by the compensation amount, and wherein the second visual telephone unit comprises: inputting means for inputting the compensation amount; and transmitting means for transmitting the compensation amount to the first visual telephone unit. [0021]
[0022] According to a seventh aspect of the present invention, there is provided a visual telephone system having a first visual telephone unit and a second visual telephone unit; wherein the first visual telephone unit comprises: inputting means for inputting a picture frame; receiving means for receiving a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame from the second visual telephone unit; and rotating means for rotating said inputting means by the compensation amount, and wherein the second visual telephone unit comprises: inputting means for inputting the compensation amount; and transmitting means for transmitting the compensation amount to the first visual telephone unit. [0022]
[0023] According to a eighth aspect of the present invention, there is provided a visual telephone system having a first visual telephone unit and a second visual telephone unit; wherein the first visual telephone unit comprises: inputting means for inputting a picture frame; receiving means for receiving a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof from the second visual telephone unit; and rotating means for rotating the picture frame so that the rotation angle becomes zero, and wherein the second visual telephone unit comprises: detecting means for detecting the rotation angle; and transmitting means for transmitting the rotation angle to the first visual telephone unit. [0023]
[0024] In the visual telephone system according to the eighth aspect, said detecting means may designate the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle. [0024]
[0025] The visual telephone system according to the eighth aspect may further comprise: a head set having two speaker portions and a microphone portion each having a light source, wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle. [0025]
[0026] According to a ninth aspect of the present invention, there is provided a visual telephone system having a first visual telephone unit and a second visual telephone unit; wherein the first visual telephone unit comprises: first inputting means for inputting a picture frame; second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and transmitting means for transmitting the compensation amount to the second visual telephone unit, and wherein the second visual telephone unit comprises: receiving means for receiving the compensation amount from the first visual telephone unit; and rotating means for rotating the picture frame by the compensation amount. [0026]
[0027] According to a tenth aspect of the present invention, there is provided a visual telephone system having a first visual telephone unit and a second visual telephone unit; wherein the first visual telephone unit comprises: inputting means for inputting a picture frame; detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and transmitting means for transmitting the rotation angle to the second visual telephone unit, and wherein the second television unit comprises: receiving means for receiving the rotation angle from the first visual telephone unit; and rotating means for rotating the picture frame so that the rotation angle becomes zero. [0027]
[0028] In the visual telephone system according to the tenth aspect, detecting means may designate the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face of a recognized picture and the horizontal line as the rotation angle. [0028]
[0029] The visual telephone system according to the tenth aspect may further comprise: a head set having two speaker portions and a microphone portion each having a light source, wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources of the picture frame and the horizontal line as the rotation angle. [0029]
[0030] These and other objects, features and advantages of the present invention will become more apparent in light of the following detailed description of a best mode embodiment thereof, as illustrated in the accompanying drawings. [0030] BRIEF DESCRIPTION OF DRAWINGS
[0031] FIG. 1 is a schematic diagram showing an external view of a conventional visual telephone conference system; [0031]
[0032] FIG. 2 is a schematic diagram showing an external view of a visual telephone conference system according to each of embodiments of the present invention; [0032]
[0033] FIG. 3 is a block diagram showing the internal structure of a visual telephone conference system according to a first embodiment of the present invention; [0033]
[0034] FIG. 4 is a block diagram showing the internal structure of a visual telephone conference system according to a second embodiment of the present invention; [0034]
[0035] FIG. 5 is a block diagram showing the internal structure of a visual telephone conference system according to a third embodiment of the present invention; [0035]
[0036] FIG. 6 is a block diagram showing the internal structure of a visual telephone conference system according to a fourth embodiment of the present invention; [0036]
[0037] FIG. 7 is a block diagram showing the internal structure of a visual telephone conference system according to a fifth embodiment of the present invention; [0037]
[0038] FIG. 8 is a block diagram showing the internal structure of a visual telephone conference system according to a sixth embodiment of the present invention; [0038]
[0039] FIG. 9 is a block diagram showing the internal structure of a visual telephone conference system according to a seventh embodiment of the present invention; and [0039]
[0040] FIG. 10 is a schematic diagram showing an external view of a visual telephone conference system according to an eighth embodiment of the present invention. [0040] DESCRIPTION OF PREFERRED EMBODIMENTS
[0041] Next, with reference to the accompanying drawings, embodiments of the present invention will be described. [0041]
[0042] FIG. 2 is a schematic diagram showing the structure of a visual telephone conference system according to each of embodiments of the present invention. [0042]
[0043] Referring to FIG. 2, the visual telephone conference system comprises a transmission side visual telephone conference unit [0043] 11 and a reception side visual telephone conference unit 21. Hereinafter, the transmission side visual telephone conference unit 11 and the reception side visual telephone conference unit 21 are referred to as transmission side unit and reception side unit, respectively. The transmission side unit 11 has a receiving function of the reception side unit 21 as well as a transmitting function of the transmission side visual telephone conference unit. Likewise, the reception side unit 21 has a transmitting function of the transmission side unit 11 as well as a receiving function of the reception side visual telephone conference unit. The structure of the transmission side unit 11 is the same as the structure of the reception side unit 21. In the following description, it is assumed that the transmission side unit 11 has only the transmitting function and that the reception side unit 21 has only the receiving function.
[0044] Each of the transmission side unit [0044] 11 and the reception side unit 21 has a user interface that comprises a microphone 51, a speaker 52, a camera 53, a liquid crystal display 54, a liquid crystal display 55, a button (or dial) 56, and a button (or dial) 57. The microphone 51 inputs a voice of the local user. The speaker 52 outputs a voice of the remote user. The camera 53 photographs a picture of the upper half of the body of the local user. The liquid crystal display 54 displays a picture of the upper half of the body of the local user including the face of the user photographed by the camera 53. The liquid crystal display 55 displays a picture of the upper half of the body including the face of the remote user. The button (or dial) 56 allows the user to input a command for causing the picture frame photographed by the camera 53 to be rotated around the perpendicular line that passes through the picture frame. The button (or dial) 57 allows the user to input a command for causing the picture frame photographed by the remote picture input unit to be rotated around the perpendicular line that passes through the picture frame. First Embodiment
[0045] According to the first embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the transmission side unit [0045] 11 by the amount of the manual operation of the transmission side unit 11.
[0046] FIG. 3 is a block diagram showing the internal structure of a visual telephone conference system according to the first embodiment of the present invention. The visual telephone conference system according to the first embodiment comprises a transmission side unit [0046] 11A as the transmission side unit 11 and a reception side unit 21A as the reception side unit 21.
[0047] The transmission side unit [0047] 11A comprises an audio inputting portion 110, a picture inputting portion 101, a rotation processing portion 102, a rotation commanding portion 103, a displaying portion 104, a modulating portion 105, and a transmitting portion 106. The reception side unit 21A comprises a receiving portion 107, a demodulating portion 108, a displaying portion 109, and an audio outputting portion 111.
[0048] The audio inputting portion [0048] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0049] The picture inputting portion [0049] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal of the picture to the rotation processing portion 102.
[0050] The rotation processing portion [0050] 102 comprises a frame memory and a rotating circuit. The digital signal that is input from the picture inputting portion 101 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the rotation commanding portion 103 so that the picture frame is rotated. The compensated digital picture signal is output to the displaying portion 104 and the modulating portion 105. The rotating circuit may be composed of a CPU or a DSP.
[0051] The rotation commanding portion [0051] 103 comprises a converter that converts an amount of the operation of the button (or dial) 56 into an electric signal. The rotation commanding portion 103 receives a rotation command from the user and outputs a command signal of the rotation command to the rotation processing portion 102.
[0052] The displaying portion [0052] 104 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 54. The displaying portion 104 displays a picture frame that is input from the picture inputting portion 101.
[0053] The modulating portion [0053] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the rotation processing portion 102 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0054] The transmitting portion [0054] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11A. The radio signal that is received by the base station is transmitted to the reception side unit 21A through an exchange station and the base station that manages the reception side unit 21A.
[0055] The receiving portion [0055] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11A and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0056] The demodulating portion [0056] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107 and outputs demodulated digital audio signal and digital picture signal to the audio outputting portion 111 and the displaying portion 109, respectively.
[0057] The displaying portion [0057] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the demodulating portion 108. When necessary, the displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0058] The audio outputting portion [0058] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0059] Next, the compensation of the rotation angle of a picture frame around the perpendicular line that passes through the picture frame will be described. [0059]
[0060] When the rotation commanding portion [0060] 103 does not send a rotation command to the rotation processing portion 102, the rotation processing portion 102 does not compensate the rotation of the picture frame of the digital picture signal. At that point, the displaying portion 104 displays a picture frame that is not compensated.
[0061] When the user of the transmission side unit [0061] 11A wants to rotate the picture frame displayed on the displaying portion 104, he or she operates the button (or dial) 56 of the transmission side unit 11A.
[0062] When the rotation processing portion [0062] 102 compensates the picture frame through the rotation commanding portion 103 corresponding to the user's operation, the picture frame displayed on the displaying portion 104 is rotated.
[0063] When the user wants to further compensate the rotated picture frame with reference to the rotated picture frame, he or she further operates the button (or dial) [0063] 56 of the transmission side unit 11A. When the member represented by reference 56 is a button, it has a right turning button and a left turning button. Whenever the right turning button is pressed, the picture frame is rotated rightward by a predetermined angle. Likewise, whenever the left turning button is pressed, the picture frame is rotated leftward by a predetermined angle. When the member represented by reference 56 is a dial, the picture frame is rotated in proportion to the rotation angle of the dial.
[0064] In such a manner, the user operates the button (or dial) [0064] 56 of the transmission side unit 11A until the rotated picture frame orients upright. Finally, the digital picture signal of the resultant picture frame is output from the rotation processing portion 102.
[0065] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0065]
[0066] The rotating circuit of the rotation processing portion [0066] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0067] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0067] Second Embodiment
[0068] According to the second embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the reception side unit [0068] 21 by the amount of the manual operation of the reception side unit 21.
[0069] FIG. 4 is a block diagram showing the internal structure of a visual telephone conference system according to the second embodiment of the present invention. The visual telephone conference system according to the second embodiment comprises a transmission side unit [0069] 11B as the transmission side unit 11 and a reception side unit 21B as the reception side unit 21.
[0070] The transmission side unit [0070] 11B comprises an audio inputting portion 110, a picture inputting portion 101, a modulating portion 105, and a transmitting portion 106. The reception side unit 21B comprises a rotation processing portion 102, a rotation commanding portion 103, a receiving portion 107, a demodulating portion 108, a displaying portion 109, and an audio outputting portion 111.
[0071] The audio inputting portion [0071] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0072] The picture inputting portion [0072] 101 comprises a camera inputting portion 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal of the picture to the modulating portion 105.
[0073] The modulating portion [0073] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the picture inputting portion 101 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0074] The transmitting portion [0074] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11B. The radio signal that is received by the base station is transmitted to the reception side unit 21B through an exchange and the base station that manages the reception side unit 21B.
[0075] The receiving portion [0075] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11B and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0076] The demodulating portion [0076] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107 and outputs demodulated digital audio signal and digital picture signal to the audio outputting portion 111 and the rotation processing portion 102, respectively.
[0077] The rotation processing portion [0077] 102 comprises a frame memory and a rotating circuit. The digital signal that is input from the demodulating portion 108 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the rotation commanding portion 103 so that the picture frame is rotated. The compensated digital picture signal is output to the displaying portion 109. The rotating circuit may be composed of a CPU or a DSP.
[0078] The rotation commanding portion [0078] 103 comprises a converter that converts an amount of the operation of the button (or dial) 57 into an electric signal. The rotation commanding portion 103 receives a rotation command from the user and outputs a command signal of the rotation command to the rotation processing portion 102.
[0079] The displaying portion [0079] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the rotation processing portion 102. When necessary, displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0080] The audio outputting portion [0080] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0081] Next, the compensation of the rotation angle of a picture frame around the perpendicular line that passes through the picture frame will be described. [0081]
[0082] When the rotation commanding portion [0082] 103 does not send a rotation command to the rotation processing portion 102, the rotation processing portion 102 does not compensate the rotation of the picture frame of the digital picture signal. At that point, the displaying portion 109 displays a picture frame that is not compensated.
[0083] When the user of the reception side unit [0083] 21B wants to rotate the picture frame displayed on the displaying portion 109, he or she operates the button (or dial) 57 of the reception side unit 21B.
[0084] When the rotation processing portion [0084] 102 compensates the picture frame through the rotation commanding portion 103 corresponding to the user's operation, the picture frame displayed on the displaying portion 109 is rotated.
[0085] When the user wants to further compensate the rotated picture frame with reference to the rotated picture frame, he or she further operates the button (or dial) [0085] 57 of the reception side unit 21B. When the member represented by reference 57 is a button, it has a right turning button and a left turning button. Whenever the right turning button is pressed, the picture frame is rotated rightward by a predetermined angle. Likewise, whenever the left turning button is pressed, the picture frame is rotated leftward by a predetermined angle. When the member represented by reference 57 is a dial, the picture frame is rotated in proportion to the rotation angle of the dial.
[0086] In such a manner, the user operates the button (or dial) [0086] 57 of the reception side unit 21B until the rotated picture frame orients upright. Finally, the digital picture signal of the resultant picture frame is output from the rotation processing portion 102.
[0087] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0087]
[0088] The rotating circuit of the rotation processing portion [0088] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0089] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0089] Third Embodiment
[0090] According to the third embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the transmission side unit [0090] 11 by the amount of the manual operation of the reception side unit 21.
[0091] FIG. 5 is a block diagram showing the internal structure of a visual telephone conference system according to the third embodiment of the present invention. The visual telephone conference system according to the third embodiment comprises a transmission side unit [0091] 11C as the transmission side unit 11 and a reception side unit 21C as the reception side unit 21.
[0092] The transmission side unit [0092] 11C comprises an audio inputting portion 110, a picture inputting portion 101, a rotation processing portion 102, a modulating portion 105, a transmitting portion 106, a receiving portion 507, and a command signal demodulating portion 508. The reception side unit 21C comprises a rotation commanding portion 103, a receiving portion 107, a demodulating portion 108, a displaying portion 109, an audio outputting portion 111, a command signal modulating portion 505, and a transmitting portion 506.
[0093] The audio inputting portion [0093] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0094] The picture inputting portion [0094] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal of the picture to the modulating portion 105.
[0095] The rotation processing portion [0095] 102 comprises a frame memory and a rotating circuit. The digital signal that is input from the picture inputting portion 101 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the command signal demodulating portion 508 so that the picture frame is rotated. The compensated digital picture signal is output to the modulating portion 105. The rotating circuit may be composed of a CPU or a DSP.
[0096] The modulating portion [0096] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the rotation processing portion 102 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0097] The transmitting portion [0097] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11C. The radio signal that is received by the base station is transmitted to the reception side unit 21C through an exchange and the base station that manages the reception side unit 21C.
[0098] The receiving portion [0098] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11C and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0099] The demodulating portion [0099] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107 and outputs demodulated digital audio signal and digital picture signal to the audio outputting portion 111 and the displaying portion 109, respectively.
[0100] The displaying portion [0100] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the demodulating portion 108. When necessary, the displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0101] The audio outputting portion [0101] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0102] The rotation commanding portion [0102] 103 comprises a converter that converts an amount of the operation of the button (or dial) 57 into an electric signal. The rotation commanding portion 103 receives a rotation command from the user and outputs a command signal of the rotation command to the command signal modulating portion 505.
[0103] The command signal modulating portion [0103] 505 modulates the command signal that is input from the rotation commanding portion 103 corresponding to a predetermined modulating system and outputs the modulated command signal to the transmitting portion 506.
[0104] The transmitting portion [0104] 506 comprises an amplifier and an antenna. The transmitting portion 506 amplifies the modulated command signal that is input from the command signal modulating portion 505 and transmits the amplified command signal as a radio signal to a base station (not shown) that manages the transmission side unit 21C. The radio signal that is received by the base station is transmitted to the transmission side unit 11C through an exchange and the base station that manages the transmission side unit 11C.
[0105] The receiving portion [0105] 507 comprises an antenna and an amplifier. The receiving portion 507 receives the radio signal that is transmitted from the reception side unit 21C and outputs the modulated command signal to the command signal demodulating portion 508.
[0106] The command signal demodulating portion [0106] 508 demodulates the modulated command signal that is input from the receiving portion 507 and outputs demodulated command signal to the rotation processing portion 102.
[0107] Next, the compensation of the rotation angle of a picture frame around the perpendicular line that passes through the picture frame will be described. [0107]
[0108] When the rotation commanding portion [0108] 103 does not send a rotation command to the rotation processing portion 102, the rotation processing portion 102 does not compensate the rotation of the picture frame of the digital picture signal. At that point, the displaying portion 109 displays a picture frame that is not compensated.
[0109] When the user of the reception side unit [0109] 21C wants to rotate the picture frame displayed on the displaying portion 109, he or she operates the button (or dial) 57 of the reception side unit 21C.
[0110] When the rotation processing portion [0110] 102 receives the command signal corresponding to the user's operation through the rotation commanding portion 103, the command signal modulating portion 505, the transmitting portion 506, the receiving portion 507, and the command signal demodulating portion 508 and then the rotation processing portion 102 compensates the rotation of the picture frame, the picture frame displayed on the displaying portion 104 is rotated.
[0111] When the user wants to further compensate the rotated picture frame with reference to the rotated picture frame, he or she further operates the button (or dial) [0111] 57 of the reception side unit 21C. When the member represented by reference 57 is a button, it has a right turning button and a left turning button. Whenever the right turning button is pressed, the picture frame is rotated rightward by a predetermined angle. Likewise, whenever the left turning button is pressed, the picture frame is rotated leftward by a predetermined angle. When the member represented by reference 57 is a dial, the picture frame is rotated in proportion to the rotation angle of the dial.
[0112] In such a manner, the user operates the button (or dial) [0112] 57 of the reception side unit 21C until the rotated picture frame orients upright. Finally, the digital picture signal of the resultant picture frame is output from the rotation processing portion 102.
[0113] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0113]
[0114] The rotating circuit of the rotation processing portion [0114] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0115] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0115]
[0116] The compensation of the rotation angle of the picture frame around the perpendicular line that passes through the picture frame may be performed by a signal process of the rotation processing portion in the receiving side unit [0116] 21 by the amount of the manual operation in the transmission side unit 11. Fourth Embodiment
[0117] According to the fourth embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by rotating a picture inputting portion with an actuator of the transmission side unit [0117] 11 by the amount of the manual operation of the reception side unit 21.
[0118] FIG. 6 is a block diagram showing the internal structure of a visual telephone conference system according to the fourth embodiment of the present invention. The visual telephone conference system according to the fourth embodiment comprises a transmission side unit [0118] 11D as the transmission side unit 11 and a reception side unit 21D as the reception side unit 21.
[0119] The transmission side unit [0119] 11D comprises an audio inputting portion 110, a picture inputting portion 101, a modulating portion 105, a transmitting portion 106, a receiving portion 507, a command signal demodulating portion 508, and an actuator 601. The reception side unit 21D comprises a rotation commanding portion 103, a receiving portion 107, a demodulating portion 108, a displaying portion 109, an audio outputting portion 111, a command signal modulating portion 505, and a transmitting portion 506.
[0120] The audio inputting portion [0120] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0121] The picture inputting portion [0121] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal of the picture to the modulating portion 105.
[0122] The modulating portion [0122] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the rotation processing portion 102 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0123] The transmitting portion [0123] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11D. The radio signal that is received by the base station is transmitted to the reception side unit 21D through an exchange and the base station that manages the reception side unit 21D.
[0124] The receiving portion [0124] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11D and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0125] The demodulating portion [0125] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107 and outputs demodulated digital audio signal and digital picture signal to the audio outputting portion 111 and the displaying portion 109, respectively.
[0126] The displaying portion [0126] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the demodulating portion 108. When necessary, the displaying portion 109 displays a picture frame whose rotation angle the actuator 601 compensates around the perpendicular line that passes through the picture frame.
[0127] The audio outputting portion [0127] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0128] The rotation commanding portion [0128] 103 comprises a converter that converts an amount of the operation of the button (or dial) 57 into an electric signal. The rotation commanding portion 103 receives a rotation command from the user and outputs a command signal of the rotation command to the command signal modulating portion 505.
[0129] The command signal modulating portion [0129] 505 modulates the command signal that is input from the rotation commanding portion 103 corresponding to a predetermined modulating system and outputs the modulated command signal to the transmitting portion 506.
[0130] The transmitting portion [0130] 506 comprises an amplifier and an antenna. The transmitting portion 506 amplifies the modulated command signal that is input from the command signal modulating portion 505 and transmits the amplified command signal as a radio signal to a base station (not shown) that manages the transmission side unit 21D. The radio signal that is received by the base station is transmitted to the transmission side unit 11D through an exchange and the base station that manages the transmission side unit 11D.
[0131] The receiving portion [0131] 507 comprises an antenna and an amplifier. The receiving portion 507 receives the radio signal that is transmitted from the reception side unit 21D and outputs the modulated command signal to the command signal demodulating portion 508.
[0132] The command signal demodulating portion [0132] 508 demodulates the modulated command signal that is input from the receiving portion 507 and outputs demodulated command signal to the actuator 601.
[0133] The actuator [0133] 601 comprises a motor such as a stepping motor. The camera 53 of the transmission side unit 11D is disposed on the rotor of the motor. The motor is rotated by an angle corresponding to the command signal. As a result, the camera 53 of the transmission side unit 11D disposed on the rotor is rotated by the angle corresponding to the command signal.
[0134] Next, the compensation of the rotation angle of a picture frame around the perpendicular line that passes through the picture frame will be described. [0134]
[0135] When the rotation commanding portion [0135] 103 does not send a rotation command to the actuator 601, it does not rotate the camera 53 of the transmission side unit 11D. Thus, the displaying portion 109 displays a picture frame that is not compensated.
[0136] When the user of the reception side unit [0136] 21D wants to rotate the picture frame displayed on the displaying portion 109, he or she operates the button (or dial) 57 of the reception side unit 21D.
[0137] When the actuator [0137] 601 receives the command signal corresponding to the user's operation through the rotation commanding portion 103, the command signal modulating portion 505, the transmitting portion 506, the receiving portion 507, and the command signal demodulating portion 508 and then the actuator 601 rotates the camera 53 of the transmission side unit 11D so as to rotate the picture frame, the picture frame displayed on the displaying portion 104 is rotated.
[0138] When the user wants to further compensate the rotated picture frame with reference to the rotated picture frame, he or she further operates the button (or dial) [0138] 57 of the reception side unit 21D. When the member represented by reference 57 is a button, it has a right turning button and a left turning button. Whenever the right turning button is pressed, the picture frame is rotated rightward by a predetermined angle. Likewise, whenever the left turning button is pressed, the picture frame is rotated leftward by a predetermined angle. When the member represented by reference 57 is a dial, the picture frame is rotated in proportion to the rotation angle of the dial.
[0139] In such a manner, the user operates the button (or dial) [0139] 57 of the reception side unit 21D until the rotated picture frame orients upright. Finally, the digital picture signal of the resultant picture frame is output from the picture inputting portion 101.
[0140] The actuator [0140] 601 may operate corresponding to a command signal received from the rotation commanding portion 103 in the transmission side unit 11D rather than the command signal received from the command signal demodulating portion 508. Fifth Embodiment
[0141] According to the fifth embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the transmission side unit [0141] 11 by the amount corresponding to an automatically recognized result of the transmission side unit 11.
[0142] FIG. 7 is a block diagram showing the internal structure of a visual telephone conference system according to the fifth embodiment of the present invention. The visual telephone conference system according to the fifth embodiment comprises a transmission side unit [0142] 11E as the transmission side unit 11 and a reception side unit 21E as the reception side unit 21.
[0143] The transmission side unit [0143] 11E comprises an audio inputting portion 110, a picture inputting portion 101, a rotation processing portion 102, a modulating portion 105, a transmitting portion 106, and a recognizing portion 701. The reception side unit 21E comprises a receiving portion 107, a demodulating portion 108, a displaying portion 109, and an audio outputting portion 111.
[0144] The audio inputting portion [0144] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0145] The picture inputting portion [0145] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal of the picture to the rotation processing portion 102 and the recognizing portion 701.
[0146] The recognizing portion [0146] 701 inputs the digital picture signal from the picture inputting portion 101, analyzes the digital picture signal, detects the rotation angle of the picture frame of the digital picture signal against an upright picture frame, and outputs a command signal corresponding to the rotation angle to the rotation processing portion 102. The rotation processing portion 102 rotates the picture frame so that the rotation angle represented by the command signal becomes zero.
[0147] The rotation processing portion [0147] 102 comprises a frame memory and a rotating circuit. The digital picture signal that is input from the picture inputting portion 101 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the recognizing portion 701 so that the picture frame is rotated. The compensated digital picture signal is output to the modulating portion 105. The rotating circuit may be composed of a CPU or a DSP.
[0148] The modulating portion [0148] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the rotation processing portion 102 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0149] The transmitting portion [0149] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11E. The radio signal that is received by the base station is transmitted to the reception side unit 21E through an exchange and the base station that manages the reception side unit 21E.
[0150] The receiving portion [0150] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11E and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0151] The demodulating portion [0151] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107 and outputs demodulated digital audio signal and digital picture signal to the audio outputting portion 111 and the displaying portion 109, respectively.
[0152] The displaying portion [0152] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the demodulating portion 108. When necessary, the displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0153] The audio outputting portion [0153] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0154] Next, the detection of the rotation angle of the picture frame represented by the digital picture signal against the upright picture frame performed by the recognizing portion [0154] 701 will be described.
[0155] Since the picture frame contains a picture of a face, the angle of the picture of the face in the picture frame is detected. As a result, the rotation angle is detected. For example, an inverse isosceles triangle formed by both the eyes and the mouth of the face of the picture is extracted. The angle of the base of the inverse isosceles triangle against the horizontal line is defined as the rotation angle. Since the areas of the eyes move due to their blinking, such two areas are recognized as eye areas by a picture signal process. In addition, when a person speaks, the mouth moves more quickly and largely than other face portions. Thus, such an area is recognized as a mouth area by a picture signal process. The center points of the two eye areas and the mouth area are connected to form the inverse isosceles triangle. [0155]
[0156] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0156]
[0157] The rotating circuit of the rotation processing portion [0157] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0158] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0158] Sixth Embodiment
[0159] According to the sixth embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the reception side unit [0159] 21 by the amount corresponding to an automatically recognized result of the reception side unit 21.
[0160] FIG. 8 is a block diagram showing the internal structure of a visual telephone conference system according to the sixth embodiment of the present invention. The visual telephone conference system according to the sixth embodiment comprises a transmission side unit [0160] 11F as the transmission side unit 11 and a reception side unit 21F as the reception side unit 21.
[0161] The transmission side unit [0161] 11F comprises an audio inputting portion 110, a picture inputting portion 101, a modulating portion 105, and a transmitting portion 106. The reception side unit 21F comprises a rotation processing portion 102, a receiving portion 107, a demodulating portion 108, a displaying portion 109, an audio outputting portion 111, and a recognizing portion 701.
[0162] The audio inputting portion [0162] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0163] The picture inputting portion [0163] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal to the modulating portion 105.
[0164] The modulating portion [0164] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the picture inputting portion 101 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0165] The transmitting portion [0165] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11F. The radio signal that is received by the base station is transmitted to the reception side unit 21F through an exchange and the base station that manages the reception side unit 21F.
[0166] The receiving portion [0166] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11F and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108.
[0167] The demodulating portion [0167] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107. The demodulating portion 108 outputs a demodulated digital audio signal to the audio outputting portion 111. In addition, the demodulating portion 108 output a demodulated digital picture signal to the rotation processing portion 102 and the recognizing portion 701.
[0168] The audio outputting portion [0168] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0169] The recognizing portion [0169] 701 inputs the digital picture signal from the demodulating portion 108, analyzes the digital picture signal, detects the rotation angle of the picture frame of the digital picture signal against an upright picture frame, and outputs a command signal corresponding to the rotation angle to the rotation processing portion 102. The rotation processing portion 102 rotates the picture frame so that the rotation angle represented by the command signal becomes zero.
[0170] The rotation processing portion [0170] 102 comprises a frame memory and a rotating circuit. The digital picture signal that is input from the demodulating portion 108 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the recognizing portion 701 so that the picture frame is rotated. The compensated digital picture signal is output to the displaying portion 109. The rotating circuit may be composed of a CPU or a DSP.
[0171] The displaying portion [0171] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the rotation processing portion 102. When necessary, the displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0172] Next, the detection of the rotation angle of the picture frame represented by the digital picture signal against the upright picture frame performed by the recognizing portion [0172] 701 will be described.
[0173] Since the picture frame contains a picture of a face, the angle of the picture of the face in the picture frame is detected. As a result, the rotation angle is detected. For example, an inverse isosceles triangle formed by both the eyes and the mouth of the face of the picture is extracted. The angle of the base of the inverse isosceles triangle against the horizontal line is defined as the rotation angle. Since the areas of the eyes move due to their blinking, such two areas are recognized as eye areas by a picture signal process. In addition, when a person speaks, the mouth moves more quickly and largely than other face portions. Thus, such an area is recognized as a mouth area by a picture signal process. The center points of the two eye areas and the mouth area are connected to form the inverse isosceles triangle. [0173]
[0174] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0174]
[0175] The rotating circuit of the rotation processing portion [0175] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0176] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0176] Seventh Embodiment
[0177] According to the seventh embodiment of the present invention, the rotation angle of the picture frame around the perpendicular line that passes through the picture frame is compensated by a signal process of a rotation processing portion of the reception side unit [0177] 21 by the amount corresponding to an automatically recognized result of the transmission side unit 11.
[0178] FIG. 9 is a block diagram showing the internal structure of a visual telephone conference system according to the seventh embodiment of the present invention. The visual telephone conference system according to the seventh embodiment comprises a transmission side unit [0178] 11G as the transmission side unit 11 and a reception side unit 21G as the reception side unit 21.
[0179] The transmission side unit [0179] 11G comprises an audio inputting portion 110, a picture inputting portion 101, a modulating portion 105, a transmitting portion 106, a recognizing portion 701, and a command signal modulating portion 904. The reception side unit 21G comprises a rotation processing portion 102, a receiving portion 107, a demodulating portion 108, a displaying portion 109, an audio outputting portion 111, and a command signal demodulating portion 908.
[0180] The audio inputting portion [0180] 110 comprises a microphone 51, an amplifier, and an A/D converter. The audio inputting portion 110 inputs a voice and outputs an digital audio signal of the voice to the modulating portion 105. The audio inputting portion 110 may further comprise a compressing portion that compresses the digital audio signal.
[0181] The picture inputting portion [0181] 101 comprises a camera 53, an amplifier, and an A/D converter. The picture inputting portion 101 inputs a picture and outputs a digital picture signal to the modulating portion 105 and the recognizing portion 701.
[0182] The recognizing portion [0182] 701 inputs the digital picture signal from the picture inputting portion 101, analyzes the digital picture signal, detects the rotation angle of the picture frame of the digital picture signal against an upright picture frame, and outputs a command signal corresponding to the rotation angle to the command signal modulating portion 904. The rotation processing portion 102 rotates the picture frame so that the rotation angle represented by the command signal becomes zero.
[0183] The modulating portion [0183] 105 modulates the digital audio signal that is input from the audio inputting portion 110 and the digital picture signal that is input from the picture inputting portion 101 corresponding to a predetermined modulating system and outputs the modulated digital audio signal and digital picture signal to the transmitting portion 106.
[0184] The command signal modulating portion [0184] 904 modulates the command signal that is input from the recognizing portion 701 corresponding to a predetermined modulating system and outputs the modulated command signal to the transmitting portion 106.
[0185] The transmitting portion [0185] 106 comprises an amplifier and an antenna. The transmitting portion 106 amplifies the modulated digital audio signal and digital picture signal that are input from the modulating portion 105 and the modulated command signal that is input from the command signal modulating portion 904 and transmits the amplified signals as a radio signal to a base station (not shown) that manages the transmission side unit 11G. The radio signal that is received by the base station is transmitted to the reception side unit 21G through an exchange and the base station that manages the reception side unit 21G.
[0186] The receiving portion [0186] 107 comprises an antenna and an amplifier. The receiving portion 107 receives the radio signal that is transmitted from the transmission side unit 11G and outputs modulated digital audio signal and digital picture signal to the demodulating portion 108. In addition, the receiving portion 107 outputs the modulated command signal to the command signal demodulating portion 908.
[0187] The demodulating portion [0187] 108 demodulates the modulated digital audio signal and digital picture signal that are input from the receiving portion 107. The demodulating portion 108 outputs a demodulated digital audio signal to the audio outputting portion 111. In addition, the demodulating portion 108 output a demodulated digital picture signal to the rotation processing portion 102.
[0188] The command signal demodulating portion [0188] 908 demodulates the command signal that is input from the receiving portion 107 and outputs the demodulated command signal to the rotation processing portion 102.
[0189] The rotation processing portion [0189] 102 comprises a frame memory and a rotating circuit. The digital picture signal that is input from the demodulating portion 108 is stored to the frame memory. The digital picture signal stored in the frame memory is compensated by the rotating circuit corresponding to a command signal received from the command signal demodulating portion 908 so that the picture frame is rotated. The compensated digital picture signal is output to the displaying portion 109. The rotating circuit may be composed of a CPU or a DSP.
[0190] The displaying portion [0190] 109 comprises a D/A converter, a liquid crystal display driver, and a liquid crystal display 55. The picture inputting portion 101 inputs the digital picture signal from the rotation processing portion 102. When necessary, the displaying portion 109 displays a picture frame whose rotation angle is compensated around the perpendicular line that passes through the picture frame by the rotation processing portion 102.
[0191] The audio outputting portion [0191] 111 comprises a D/A converter, an amplifier, and a speaker 52. The audio outputting portion 111 outputs a voice that is input from the audio inputting portion 110 corresponding to a digital audio signal that is input from the demodulating portion 108.
[0192] Next, the detection of the rotation angle of the picture frame corresponding to the digital picture signal against the upright picture frame by the recognizing portion [0192] 701 will be described.
[0193] Since the picture frame contains a picture of a face, the angle of the picture of the face in the picture frame is detected. As a result, the rotation angle is detected. For example, an inverse isosceles triangle formed by both the eyes and the mouth of the face of the picture is extracted. The angle of the base of the inverse isosceles triangle against the horizontal line is defined as the rotation angle. Since the areas of the eyes move due to their blinking, such two areas are recognized as eye areas by a picture signal process. In addition, when a person speaks, the mouth moves more quickly and largely than other face portions. Thus, such an area is recognized as a mouth area by a picture signal process. The center points of the two eye areas and the mouth area are connected to form the inverse isosceles triangle. [0193]
[0194] The picture frame is rotated using the affine transformation. In the affine transformation, when the two-dimensional coordinate of a particular point that has not been rotated is denoted by (X, Y), the coordinate of the rotating axis is denoted by (A, B), and the rotation angle is denoted by θ, the two-dimensional coordinate of the point that has been rotated is expressed as follows: [0194]
[0195] The rotating circuit of the rotation processing portion [0195] 102 manipulates the addresses of the picture signal stored in the frame memory corresponding to the affine transformation. For example, the read addresses of the digital picture signal written in the frame memory are controlled corresponding to the above-described expressions.
[0196] The coordinate of the rotating axis (A, B) is set at the center point of the picture frame. [0196]
[0197] The rotation angle of the picture frame around the perpendicular line that passes through the picture frame may be compensated by a signal process of the rotation processing portion in the transmission side unit [0197] 11 corresponding to the automatically recognized result in the reception side unit 21. Eighth Embodiment
[0198] The eighth embodiment of the present invention is a modification of the picture recognition of each of the fifth to seventh embodiment of the present invention. [0198]
[0199] According to the fifth to seventh embodiments, the rotation angle of the picture frame that is input from the picture inputting portion [0199] 101 against the upright picture frame is detected by a picture recognition of the eyes and the mouth of a face in a picture. However, according to the eighth embodiment of the present invention, the rotation angle is detected in the following manner.
[0200] As shown in FIG. 10, a head set [0200] 201 is connected to the transmission side unit 11. In addition, another head set 201 is connected to the reception side unit 21, because the reception side unit 21 also functions as the transmission side unit 11.
[0201] First light sources are disposed in speaker portions [0201] 202 of the head set 201. A second light source is disposed in a microphone portion 203 of the head set 201. The first light source is for example an infrared ray light source having a first predetermined wavelength. The second light source is for example an infrared ray light source having a second predetermined wavelength. It is necessary to cause the intensities of infrared rays of those light sources to be stronger than the intensity of infrared ray radiated from the human body.
[0202] The picture inputting portion [0202] 101 further comprises a filter that passes infrared rays as well as three types of filters that pass visible light rays. In addition, the picture inputting portion 101 further comprises an image pickup device that receives infrared rays as well as three image pickup devices that receive visible rays.
[0203] The recognizing portion [0203] 701 detects the positions of the first light sources and the second light source corresponding to a digital picture signal received from the infrared ray image pickup device, extracts an inverse isosceles triangle from the positions of the two first light sources and the position of the one second light source, and obtains the rotation angle of the picture frame that is input from the picture inputting portion 101 against the upright picture frame corresponding to the slope of the base of the inverse isosceles triangle.
[0204] Although the present invention has been shown and described with respect to the best mode embodiment thereof, it should be understood by those skilled in the art that the foregoing and various other changes, omissions, and additions in the form and detail thereof may be made therein without departing from the spirit and scope of the present invention. [0204]

权利要求:
Claims (18)
[1" id="US-20010008412-A1-CLM-00001] 1. A visual telephone unit, comprising:
first inputting means for inputting a picture frame;
second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and
rotating means for rotating the picture frame by the compensation amount.
[2" id="US-20010008412-A1-CLM-00002] 2. A visual telephone unit, comprising:
first inputting means for inputting a picture frame;
second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and
rotating means for rotating said first inputting means by the compensation amount.
[3" id="US-20010008412-A1-CLM-00003] 3. A visual telephone unit, comprising:
first inputting means for inputting a picture frame;
detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and
rotating means for rotating the picture frame so that the rotation angle becomes zero.
[4" id="US-20010008412-A1-CLM-00004] 4. The visual telephone unit as set forth in
claim 3 ,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle.
[5" id="US-20010008412-A1-CLM-00005] 5. The visual telephone unit as set forth in
claim 3 , further comprising:
a head set having two speaker portions and a microphone portion each having a light source,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle.
[6" id="US-20010008412-A1-CLM-00006] 6. A visual telephone unit, comprising:
receiving means for receiving a picture frame;
inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and
rotating means for rotating the picture frame by the compensation amount.
[7" id="US-20010008412-A1-CLM-00007] 7. A visual telephone unit, comprising:
receiving means for receiving a picture frame;
detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and
rotating means for rotating the picture frame so that the rotation angle becomes zero.
[8" id="US-20010008412-A1-CLM-00008] 8. The visual telephone unit as set forth in
claim 7 ,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle.
[9" id="US-20010008412-A1-CLM-00009] 9. The visual telephone unit as set forth in
claim 7 , further comprising:
a head set having two speaker portions and a microphone portion each having a light source,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle.
[10" id="US-20010008412-A1-CLM-00010] 10. A visual telephone system having a first visual telephone unit and a second visual telephone unit;
wherein the first visual telephone unit comprises:
inputting means for inputting a picture frame;
receiving means for receiving a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame from the second visual telephone unit; and
rotating means for rotating the picture frame by the compensation amount, and
wherein the second visual telephone unit comprises:
inputting means for inputting the compensation amount; and
transmitting means for transmitting the compensation amount to the first visual telephone unit.
[11" id="US-20010008412-A1-CLM-00011] 11. A visual telephone system having a first visual telephone unit and a second visual telephone unit;
wherein the first visual telephone unit comprises:
inputting means for inputting a picture frame;
receiving means for receiving a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame from the second visual telephone unit; and
rotating means for rotating said inputting means by the compensation amount, and
wherein the second visual telephone unit comprises:
inputting means for inputting the compensation amount; and
transmitting means for transmitting the compensation amount to the first visual telephone unit.
[12" id="US-20010008412-A1-CLM-00012] 12. A visual telephone system having a first visual telephone unit and a second visual telephone unit;
wherein the first visual telephone unit comprises:
inputting means for inputting a picture frame;
receiving means for receiving a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof from the second visual telephone unit; and
rotating means for rotating the picture frame so that the rotation angle becomes zero, and
wherein the second visual telephone unit comprises:
detecting means for detecting the rotation angle; and
transmitting means for transmitting the rotation angle to the first visual telephone unit.
[13" id="US-20010008412-A1-CLM-00013] 13. The visual telephone system as set forth in
claim 12 ,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face in a recognized picture and the horizontal line as the rotation angle.
[14" id="US-20010008412-A1-CLM-00014] 14. The visual telephone system as set forth in
claim 12 , further comprising:
a head set having two speaker portions and a microphone portion each having a light source,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources in the picture frame and the horizontal line as the rotation angle.
[15" id="US-20010008412-A1-CLM-00015] 15. A visual telephone system having a first visual telephone unit and a second visual telephone unit;
wherein the first visual telephone unit comprises:
first inputting means for inputting a picture frame;
second inputting means for inputting a compensation amount of a rotation angle of the picture frame around a perpendicular line that passes through the picture frame; and
transmitting means for transmitting the compensation amount to the second visual telephone unit, and
wherein the second visual telephone unit comprises:
receiving means for receiving the compensation amount from the first visual telephone unit; and
rotating means for rotating the picture frame by the compensation amount.
[16" id="US-20010008412-A1-CLM-00016] 16. A visual telephone system having a first visual telephone unit and a second visual telephone unit;
wherein the first visual telephone unit comprises:
inputting means for inputting a picture frame;
detecting means for detecting a rotation angle of the picture frame around a perpendicular line that passes through the picture frame against an upright picture thereof; and
transmitting means for transmitting the rotation angle to the second visual telephone unit, and
wherein the second television unit comprises:
receiving means for receiving the rotation angle from the first visual telephone unit; and
rotating means for rotating the picture frame so that the rotation angle becomes zero.
[17" id="US-20010008412-A1-CLM-00017] 17. The visual telephone system as set forth in
claim 16 ,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting both the eyes and the mouth of a face of a recognized picture and the horizontal line as the rotation angle.
[18" id="US-20010008412-A1-CLM-00018] 18. The visual telephone system as set forth in
claim 16 , further comprising:
a head set having two speaker portions and a microphone portion each having a light source,
wherein said detecting means designates the angle made by the base of an inverse isosceles triangle formed by connecting the light sources of the picture frame and the horizontal line as the rotation angle.

类似技术:

---

公开号 | 公开日 | 专利标题

---

US6791597B2|2004-09-14|Visual telephone unit and visual telephone system therewith

---

CA2391994C|2005-01-25|Mobile communications

---

US7127271B1|2006-10-24|Communication device

---

US6424843B1|2002-07-23|Multi-function telecommunication device

---

US7126626B2|2006-10-24|Multifunctional mobile electronic device

---

US7227565B2|2007-06-05|Electronic apparatus equipped with image capturing device and microphone

---

JP2002290793A|2002-10-04|Mobile phone with image pickup device

---

US20040008423A1|2004-01-15|Visual teleconferencing apparatus

---

WO2005074168A1|2005-08-11|Portable terminal with built-in camera for visible light communication

---

US20040198439A1|2004-10-07|Device and method for displaying pictures in a mobile terminal

---

JP3380835B2|2003-02-24|Portable videophone

---

JP2002191067A|2002-07-05|Mobile communication unit

---

JPH10313452A|1998-11-24|Portable radio communication equipment

---

KR101199349B1|2012-11-09|Mobile phone having image communication function

---

JP3804766B2|2006-08-02|Image communication apparatus and portable telephone

---

JPH0758814A|1995-03-03|Portable telephone set

---

JPH0746556A|1995-02-14|Radio video telephone system

---

US20050122404A1|2005-06-09|[portable communication device]

---

KR20020049391A|2002-06-26|Image hand-phone

---

KR100747581B1|2007-08-08|Mobile terminal having cameras and method for transmitting and receiving data using the same

---

JP2001320460A|2001-11-16|Mobile terminal and image transmission method

---

EP1081943A1|2001-03-07|Digital transceiver camera

---

KR20040058932A|2004-07-05|Device for sensing rotation angle of rotating mobile phone with camera and Method the same

---

JP2000197026A|2000-07-14|Portable equipment

---

CN209250759U|2019-08-13|A kind of infrared thermoviewer with remote radio communication function

同族专利:

---

公开号 | 公开日

---

JP2001197462A|2001-07-19|

---

US6791597B2|2004-09-14|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

EP1298925A2|2001-09-28|2003-04-02|Matsushita Electric Industrial Co., Ltd.|Moving picture communication method and apparatus|

---

EP1540926A1|2002-08-30|2005-06-15|Fujitsu Limited|Folding-type electronic device|

---

EP1549067A2|2003-12-26|2005-06-29|Lg Electronics Inc.|Mobile communication device with enhanced image communication capabiltiy|

---

US20060148455A1|2004-12-30|2006-07-06|Lg Electronics Inc.|Mobile terminal and method for associating photos with telephone numbers in a mobile terminal|

---

US20070035616A1|2005-08-12|2007-02-15|Lg Electronics Inc.|Mobile communication terminal with dual-display unit having function of editing captured image and method thereof|

---

US7224999B1|1999-09-29|2007-05-29|Kabushiki Kaisha Toshiba|Radio communication terminal with simultaneous radio communication channels|

---

US20090002475A1|2007-06-27|2009-01-01|General Instrument Corporation|Apparatus and System for Improving Image Quality|

---

US20090059497A1|2007-08-29|2009-03-05|Nintendo Co., Ltd.|Imaging apparatus|

---

US20090122154A1|2004-07-27|2009-05-14|Tae-Haeng Lee|Image signal processing apparatus and method thereof in mobile communications terminal|

---

US20090278974A1|2007-08-29|2009-11-12|Nintendo Co., Ltd.|Hand-held imaging apparatus and storage medium storing program|

---

US20110234857A1|2008-06-13|2011-09-29|Nintendo Co., Ltd.|Information processing apparatus and computer-readable storage medium recording information processing program|

---

EP2442562A1|2010-10-12|2012-04-18|Research in Motion Limited|Method and apparatus for image orientation indication and correction|

---

WO2013085546A1|2011-12-09|2013-06-13|Hewlett-Packard Development Company, Lp|Modification of images based on orientation|

---

EP2621160A1|2010-09-22|2013-07-31|NEC CASIO Mobile Communications, Ltd.|Image pick-up device, image transfer method and program|

---

US8608392B2|2007-08-29|2013-12-17|Nintendo Co., Ltd.|Imaging apparatus|

---

US20150070458A1|2012-02-03|2015-03-12|Samsung Sds Co., Ltd.|System and method for video call|

---

US9135026B2|2008-06-13|2015-09-15|Nintendo Co., Ltd.|Information-processing apparatus having photography applications|

---

US9630099B2|2008-10-01|2017-04-25|Nintendo Co., Ltd.|Information processing device, information processing system, and launch program and storage medium storing the same providing photographing functionality|JPH01300789A|1988-05-30|1989-12-05|Fujitsu Ltd|Direction control system for camera in video telephone equipment|

---

JPH0652945B2|1988-08-24|1994-07-06|日本電信電話株式会社|Video phone|

---

JPH0358589A|1989-07-27|1991-03-13|Toshiba Corp|Video telephone set|

---

JPH04105488A|1990-08-24|1992-04-07|Seiko Epson Corp|Video telephone set|

---

JPH04105489A|1990-08-24|1992-04-07|Seiko Epson Corp|Video telephone set|

---

JP2996534B2|1991-05-14|2000-01-11|株式会社東芝|Facsimile machine|

---

JPH05268599A|1992-03-17|1993-10-15|Fujitsu Ltd|Automatic control system for portrait pickup camera in television conference system|

---

JP3368672B2|1994-06-30|2003-01-20|日本ビクター株式会社|Head mounted display|

---

JPH08256316A|1995-03-17|1996-10-01|Toshiba Corp|Communication conference system|

---

JP3603409B2|1995-09-19|2004-12-22|松下電器産業株式会社|Image communication device|

---

JPH113493A|1997-06-13|1999-01-06|Toyota Motor Corp|Video information providing device, its method and medium storing program for them|

---

JPH11196397A|1997-12-26|1999-07-21|Canon Inc|Display device and communication system|

---

JPH11203455A|1998-01-09|1999-07-30|Omron Corp|Image generating device, its method and recording medium|

---

JPH11205724A|1998-01-16|1999-07-30|Sony Corp|Video image recorder|US7224962B1|1997-10-03|2007-05-29|Karen Jeanne Kite|Remote operational screener|

---

US20030117497A1|2001-12-21|2003-06-26|Claus Nicolaisen|Communication terminal provided with a camera|

---

US20030201987A1|2002-04-25|2003-10-30|Samsung Electronics Co., Ltd.|Device and method for adjusting inverted image in display system|

---

KR100471148B1|2002-06-05|2005-02-21|삼성전기주식회사|Cellular Phone equipped with a camera|

---

KR100487616B1|2002-11-29|2005-05-03|엘지전자 주식회사|Folder type mobile phone|

---

JP3972834B2|2003-02-21|2007-09-05|ソニー株式会社|Input device, portable electronic device, and input method of portable electronic device|

---

KR100630098B1|2004-02-20|2006-09-27|삼성전자주식회사|Portable digital communication device|

---

US20050264653A1|2004-05-27|2005-12-01|Starkweather James A|Portable electronic device with adjustable image capture orientation and method therefore|

---

JP2007019693A|2005-07-06|2007-01-25|Audio Technica Corp|On-plane sound collection microphone|

---

US20070081195A1|2005-10-07|2007-04-12|Sbc Knowledge Ventures, L.P.|Digital photographic display device|

---

US20070081643A1|2005-10-07|2007-04-12|Sbc Knowledge Ventures, L.P.|Digital photographic display device|

---

US7978376B2|2005-10-07|2011-07-12|At&T Intellectual Property I, L.P.|Digital photographic display device|

---

JP4871357B2|2006-06-28|2012-02-08|富士通株式会社|Mobile device and video communication system|

---

KR101474754B1|2008-01-30|2014-12-19|삼성전자주식회사|Portable information terminal|

---

JP4979622B2|2008-03-17|2012-07-18|ヤフー株式会社|Server, method, and program for providing map screen|

---

WO2013085544A1|2011-12-09|2013-06-13|Hewlett-Packard Development Company, Lp|Generation of images based on orientation|

---

US9438818B2|2012-06-20|2016-09-06|Qualcomm Incorporated|Device and method for multimedia communications with picture orientation information|

---

US10013020B2|2014-01-29|2018-07-03|Hewlett-Packard Development Company, L.P.|Electronic device with flexible display|

---

US9772659B2|2015-07-21|2017-09-26|LenovoCo., Ltd.|Connecting device and an electronic apparatus|

法律状态:
2001-01-11| AS| Assignment|Owner name: NEC CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ANDO, TAKESHI;TAKIZAWA, MASAKATSU;REEL/FRAME:011453/0090 Effective date: 20010105 |

---

2004-08-26| STCF| Information on status: patent grant|Free format text: PATENTED CASE |

---

2008-02-15| FPAY| Fee payment|Year of fee payment: 4 |

---

2011-09-22| FPAY| Fee payment|Year of fee payment: 8 |

---

2016-03-02| FPAY| Fee payment|Year of fee payment: 12 |

优先权:

---

申请号 | 申请日 | 专利标题

---

JP2000-008160||2000-01-17||

---

JP2000008160A|JP2001197462A|2000-01-17|2000-01-17|Visual telephone equipment and visual telephone system provided with the same|

---